Empirical evaluation of multi-task learning in deep neural networks for natural language processing
نویسندگان
چکیده
منابع مشابه
Rapid adaptation for deep neural networks through multi-task learning
We propose a novel approach to addressing the adaptation effectiveness issue in parameter adaptation for deep neural network (DNN) based acoustic models for automatic speech recognition by adding one or more small auxiliary output layers modeling broad acoustic units, such as mono-phones or tied-state (often called senone) clusters. In scenarios with a limited amount of available adaptation dat...
متن کاملMulti-task learning deep neural networks for speech feature denoising
Traditional automatic speech recognition (ASR) systems usually get a sharp performance drop when noise presents in speech. To make a robust ASR, we introduce a new model using the multi-task learning deep neural networks (MTL-DNN) to solve the speech denoising task in feature level. In this model, the networks are initialized by pre-training restricted Boltzmann machines (RBM) and fine-tuned by...
متن کاملAn Overview of Multi-Task Learning in Deep Neural Networks
Multi-task learning (MTL) has led to successes in many applications of machine learning, from natural language processing and speech recognition to computer vision and drug discovery. This article aims to give a general overview of MTL, particularly in deep neural networks. It introduces the two most common methods for MTL in Deep Learning, gives an overview of the literature, and discusses rec...
متن کاملDeep Learning for Natural Language Processing
Deep learning has emerged as a new area of machine learning research. It tries to mimic the human brain, which is capable of processing and learning from the complex input data and solving different kinds of complicated tasks well. It has been successfully applied to several fields such as images, sounds, text and motion. The techniques developed from deep learning research have already been im...
متن کاملDeep Learning in Natural Language Processing
Deep learning has emerged as a highly efficient technique in machine learning to perform text analytics, which includes text classification, text sequence learning, sentiment analysis, question-answer engine, etc. This paper presents the concept and steps of using deep learning in NLP, ways to pull out the features from the text, ways to prepare data for deep learning and popular methods that a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Computing and Applications
سال: 2020
ISSN: 0941-0643,1433-3058
DOI: 10.1007/s00521-020-05268-w